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METHOD OF SYNCHRONIZING MOTION OF COOPERATIVE GAME SYSTEM, 
METHOD OF REALIZING INTERACTION BETWEEN PLURALITIES OF 
COOPERATIVE GAME SYSTEM USING IT AND COOPERATIVE GAME METHOD 

5 BACKGROUND OF THE INVENTION 

1. Field of Invention 

The present invention relates to a method for synchronizing motions in a cooperative 
game system, a method for implementing interactions between a number of cooperative game 

10 systems to which the synchronizing method is applied, and a cooperative gaming method. 
More particularly, the present invention relates to a method for synchronizing motions in a 
cooperative game system, in which structures are displayed in synchronization with a unit time 
so that the structures integrally and simultaneously implement one unit motion corresponding to 
events input by a variety of input devices in a cooperative game system including dance games, 

15 implemented in the form of a single system or a remote client system over a network; to a 
method for implementing interactions between a number of cooperative game systems in which 
a unit motion is executed in each cooperative game system by applying such a method for 
synchronizing motions in a cooperative game system, and at the same time, a new unit motion is 
displayed by synchronizing interaction motions between a number of cooperative game systems; 

20 and to a method for a cooperative game including dance games, applied with the method for 
implementing interactions between a number of cooperative game systems. 

2. Description of the Prior Art 

Generally, in computer graphics, the extraction and application of features of key 
25 portions of actual motions are needed in order to represent motions of a structure in a realistic 
manner, in which the structure refers to an object that balances upon realizing motions by means 
of joints, rotation range of joints, balance maintaining motions, and the like, such as humans or 
animals. 

To this end, features of relevant motions of the structure should be analyzed and the 
30 weight of motions should also be specified. At this time, if there are interactions between two 
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structures, the weight of an arbitrary motion must be recognized in a state where one structure 
does not know motions of the other to be executed in the future. 

Therefore, there arises a problem that motions between two structures are exhibited 
clumsily because the weight of motions depending on interaction between the structures is not 
specified correctly. 

To solve this problem, an inverse kinematics model and the like have been suggested 
which extracts and applies key motion features that are captured from inter-structure motions 
resulting from the interactions between the structures. 

However, this inverse kinematics model method is applied only between a single 
structure, in which interactions between two or more structures are not considered, and the single 
structure. 

In a case where such interactions are considered, the inverse kinematics model method 
cannot be applied between two or more structures because problems in predicting motions 
cannot be solved when interference occurs between two or more structures. 

That is, with only the presently disclosed technologies other than the present invention, 
it is impossible to implement synchronization in which interactions between two or more 
structures are considered. 

SUMMARY OF THE INVENTION 



The present invention is conceived to solve the aforementioned problems with the prior 
art. It is an object of the invention to provide a method for synchronizing motions in a 
cooperative game system in which two or more structure motions by input events are integrally 
and concurrently realized by synchronizing the motions to a unit time in a cooperative game 
25 system including dance games. 

Further, it is another object of the invention to provide a method for realizing interaction 
between a number of cooperative game systems in which motion interactions between a number 
of cooperative game systems can be controlled by applying such a method for synchronizing 
motions in a cooperative game system, and to provide a cooperative gaming method including 
dance games, applied with the method for realizing interactions between a number of 
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cooperative game systems. 

According to an aspect of the present invention for achieving the aforementioned objects, 
there is provided a method for synchronizing motions realized in a game system including dance 
games played through cooperation between players, wherein: if, with respect to an event input by 
one player during any one of unit time when progress is repeated in synchronization with a 
standard time, another player inputs the same event, a unit motion corresponding to the input 
event is simultaneously represented through the structure during a subsequent unit time. 

Preferably, the cooperative game system may be implemented in the form of a single 

system. 

Preferably, the cooperative game system may be implemented in the form of a remote 
client system over a network. 

Preferably, the event may be input by one or a combination of a keyboard, mouse, 
trackball, joystick, touch screen, cellular phone key pad, dance pad, and network interface card 
(NIC). 

Preferably, the event may be input by a direct action input device with cameras or 
sensors and a voice input device such as a microphone. 

Preferably, the standard time may be set as a world time code (WTC). 
Preferably, the unit motion may be set while storing frame vertex positions and data that 
correspond to respective motion scenes and producing data through interpolation calculations. 
20 Preferably, the unit motion may be set while dividing the structure into several 

substructures, defining each relationship for the substructures, and producing data by specifying 
data for the divided substructures every frame or varying frame. 

Preferably, the unit motion may be set while producing data through movement along 
position values in a hierarchical structure that defines respective relationships based on structure 
25 data of a joint unit called a bone. 

Preferably, the unit motion may additionally use sound and is displayed in 
synchronization with the sound. 

Preferably, the sound may be one of WAV, MP3, WMA or MIDI format. 
Preferably, the unit motion may be displayed in synchronization with a standard time in 
30 which the standard time is set in conformity with a playing time of the sound. 
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Preferably, the unit motion may be output and displayed via an image output device and 
a sound output device. 

Preferably, the image output device may be any one of a monitor, a head up display 
device (HUD), or an LCD panel. 
5 Preferably, the sound output device may be a speaker. 

Preferably, the image output device may confirm input/output intermediation states via a 
solid object through transmission and reception to and from the solid object. 

Further, according to another aspect of the present invention for achieving the 
aforementioned objects, there is provided a method for implementing interactions between a 
10 plurality of cooperative game systems generated in a course of individually realizing unit 
motions of each of the cooperative game systems by applying the method for synchronizing 
motions in the cooperative game system of claim 1, wherein: if, with respect to an event input by 
one player during any one of unit times when progress is repeated in synchronization with a 
standard time, another player inputs the same event, each of the plurality of cooperative game 
15 system realizes a unit motion corresponding to the input event through the structure during a 
subsequent unit time, and at the same time, allows interactions generated by an individual unit 
motion implemented at each cooperative game system to be represented as a new unit motion by 
applying the method for synchronizing motions in the cooperative game system. 
Preferably, the standard time may be set as a world time code (WTC). 
20 Preferably, the plurality of cooperative game systems may be implemented in the form 

of server/client by one server system and a plurality of client systems. 

Preferably, the plurality of cooperative game systems may be implemented in the form 
of peer to peer by a plurality of client systems. 

Preferably, the peer-to-peer form may be serviced via one or a combination of 
25 information sharing types and resource sharing types. 

Preferably, the peer to peer form may use one or multiplicity of scripters such as Ping, 
Pong, Query, Queryhit, Push, and the like. 

Preferably, the client system may include a video game machine, such as PS2, Xbox, 
GameCube, PSP, PSX, N-Gage, Nintendo DS and the like in which an on-line or two-person 
30 game is possible with a separate memory. 
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Further, according to yet another aspect of the present invention for achieving the 
aforementioned objects, there is provided a method for a cooperative game including dance 
games applied with the method for implementing interactions between a plurality of cooperative 
game systems generated in the course of individually realizing unit motions of each of the 
cooperative game systems by applying the method for synchronizing motions in the cooperative 
game system of claim 1, wherein: if, with respect to an event input by one player during any one 
of unit times when progress is repeated in synchronization with a standard time, another player 
inputs the same event, each of the plurality of cooperative game system realizes a unit motion 
corresponding to the inputted event through the structure during a subsequent unit time, and at 
the same time, plays the game while allowing interactions generated by an individual unit 
motion implemented at each cooperative game system to be represented as a new unit motion by 
applying the method for synchronizing motions in the cooperative game system. 

Preferably, the unit motion may have a first pose and a last pose matched to each other. 
Preferably, the unit motion may have a playing time that is adjusted by tempo. 
Preferably, the unit motion may include movements in eight directions of front, back, 
left, right, front-left, front-right, back-left, and back-right. 

Preferably, the unit motion may include 90° rotation, 180° rotation, 360° rotation, and a 
special unit motion. 

Preferably, the unit motion may include sitting, standing, bending, and successively 

20 rotating. 

Preferably, the unit motion may include joints constituting a structure and motion 
modifications by the joints. 

Preferably, the unit motion may have as one unit several joints constituting a structure 
and several combinations of a plurality of motions by the joints. 
25 Preferably, processing may be made with a temporal effect by a mechanical control in a 

controller, or a spatial and physical effect such as a drag force and action/reaction upon 
controlling structure motions. 

Preferably, the event may be input by one or a combination of a keyboard, mouse, 
joystick, key panel, dance pad, and network interface card (NIC). 
30 Preferably, the event may be such that position values input via various sensors or 
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cameras are input as motion data. 

Preferably, the structure may be a two or three-dimensional object. 

Preferably, the object may be implemented by a combination of an object made based on 
images input via cameras or the like, and an actual image. 
5 Preferably, the structure may be an avatar made by a separate modeling tool. 

Preferably, the system may include a separate chatting tool to exchange conversation 
with a party system by means of character or voice systems. 

Preferably, the system may be include a video game machine, such as PS2, XBox, 
GameCube, PSP, PSX, N-Gage, Nintendo DS in which an on-line game or a two-or-more 
1 0 person-game is possible with a separate memory. 

Preferably, the unit motion may be played by two persons like a sports dance. 

Preferably, the sports dance may be played as one or combination of waltz, tango, fox 
trot, Vienna waltz, quickstep, jive, rumba, chachacha, samba, passodobbele, and blues. 

Preferably, the unit motion may be made by one or combination of swing, salsa, disco, 
15 twist, mambo, hip-pop, synchronized swimming, and ice dancing. 



BRIEF DESCRIPTION OF THE DRAWINGS 

20 The above and other objects and features of the present invention will become apparent 

from the following description of preferred embodiments given in conjunction with the 
accompanying drawings, in which: 

Figs. 1 and 2 are a schematic configuration diagram and a schematic functional block 
diagram, respectively, for implementing a method for synchronizing motions in a cooperative 
25 game system according to an embodiment of the present invention; 

Fig. 3 is a function block diagram for implementing a method for synchronizing motions 
in a cooperative game system according to an embodiment of the present invention in the form 
of a remote client system over a network; 

Fig. 4 is a flow diagram showing an overall process of synchronizing motions in a 
30 cooperative game system including dance games realized in the form of the client system of Fig. 
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3; 

Fig. 5 is a flow diagram showing a motion input processing subroutine for a first client 
system as a leader in the cooperative game system including dance of Fig. 4; 

Fig. 6 is a flow diagram showing a motion input processing subroutine for a second 
client system as a follower in the cooperative game system including dance of Fig. 4; 

Fig. 7 illustrates exemplary GUI screens displayed on monitors of a first client system as 
a leader and a second client system as a follower, which are users, in the cooperative game 
system including dance of Fig. 4; 

Figs. 8 to 15 are exemplary screens displayed in the first client system as a leader while 
a cooperative game is being played in the cooperative game system including dance of Fig. 4; 



and 



Figs. 16 to 23 illustrate exemplary screens displayed in a second client system as a 
follower while a cooperative game is being played in the cooperative game system including 
dance games of Fig. 4. 

DETAILED DESCRIPTION OF THE INVENTION 



Hereinafter, a method for synchronizing motions in a cooperative game system a 
method for implementing interaction between a number of cooperative game systems to which 
20 the synchronizing method is applied, and a cooperative gaming method including dance games 
according to an embodiment of the present invention will be described in more detail with 
reference to the accompanying drawings. 

Fig. 1 is a schematic configuration diagram for implementing a method for 
synchronizing motions in a cooperative game system according to an embodiment of the present 
25 invention. 

According to an embodiment of the present invention, the cooperative game system 
includes an input unit 100, an operational processing unit 110, a synchronizing unit 120 an 
interface unit 130, and an output unit 140. Here, a cooperative game means a game which is 
played while a number of structures cooperatively make one completed motion, for example, in 
30 such a manner that one step is completed while a follower follows the motion of a leader in a 
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dance game such as a tango. 

The input unit 100 generates an event selected to display a specific motion according to 
a user's request. This input unit 100 is a human interface and inputs data and information to the 
operational processing unit 110 by means of a number of keys on a computer or a portable unit. 
The input unit 100 may be generally implemented by one or a combination of a keyboard, mouse 
trackball, joystick, touch screen, cellular phone key pad, dance pad, and network interface card' 
(NIC). 

The operational processing unit 110 includes a central processing unit, ROM, RAM 
cathode ray tube (CRT) controlling unit, and controlling unit, all of which is not shown. ' 

Here, the central processing unit (CPU) performs operation and system control by means 
of a control program, is composed of a micro processing unit (MPU) and the like, initiates a 
control program stored in ROM, and performs an operation for executing a data control process 
according to the control program. 

The ROM is a nonvolatile memory, and stores the control program of the central 
processing unit. 

Further, the RAM stores data or contents needed for the central processing unit to run 
the control program, or an operation result needed in an operation process of the central 
processing unit. 

Further, the CRT controlling unit sequentially reads data or content stored in the RAM 
over a predetermined period by using an address, converts them to a video signal, and outputs 
the video signal to the output unit 140. 

Further, the controlling unit delivers the video signal and audio signal, generated at the 
CRT controlling unit, to a screen output unit and a sound output unit via the interface unit 130, 
respectively. 

The synchronizing unit 120 matches time differences between users to be same by 
comparing an event, generated from the input unit 100, to a standard time and correcting time 
differences. This synchronizing unit 120 includes an obtained time setting unit, a time 
synchronizing unit, a unit motion setting unit, and a unit motion synchronizing unit, all of which 
are not shown. 

Here, the time setting unit sets a standard time for matching user times to one standard. 
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As a method of setting a standard time, a method is used which sets a clock of an atom clock 
server on Internet or a server for an on-line or web service to the standard time, and which 
matches the user time to the standard time at a state where an on-line or Internet connection is 
established. On the other hand, in a case where a connection is made between devices at a state 

5 where the on-line and web connection is not established, each time or a specified time of the 
devices may be used as the standard time as it is. 

In the case where the game system is implemented in the form of a single system as well 
as, particularly, in the form of a remote client system over a network, the time synchronizing unit 
serves to eliminate event time differences resulting from information transmission by calculating 

10 time differences due to transmission time differences caused when the server transmits 
information, based on the standard time set by the time setting unit and an inter-user 
transmission time, and by delivering the time differences via the interface unit 130 for the user. 
Further, the time synchronizing unit also serves to match the events to each other by re- 
calculating the time differences through consideration of the transmission time delay due to 

15 server load. 

The unit motion setting unit allows motion playing, such as progress, rotation, and 
balance maintenance by classfying unit motions by joints, constituting a structure, and motions 
by the joints. A scheme of generating data according to proceeding with a variety of motions at 
this unit motion setting unit includes a calculation scheme with interpolation, a skeletal 

20 animation scheme, and a bone animation or skinning animation scheme. The scheme with 
interpolation (i.e., vertex animation or key frame animation) is a scheme in which each vertex 
position and related data in a frame corresponding to a scene by each motion are stored and then 
are calculated by linear interpolation or other interpolations. The skeletal animation is a 
scheme in which a structure is divided into several substructures, each relationship therebetween 

25 is defined, and data including movement, reduction, and rotation of each divided substructure is 
stored and used every frame or varying frame. The bone animation is a scheme in which a 
hierarchical structure is included which defines each relationship based on structure data for a 
joint unit called a bone, and movement is made with a position value. Using the bone 
animation scheme enables data to be generated from motions based only on smooth motions and 

30 less data files. 
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The unit motion synchronizing unit allows inter-structure events and motion occurrences 
to be simultaneously implemented based on a time synchronized to each user on a basis of the 
set standard time, in order to consider interactions between one structure and another structure 
remotely connected between the users. 

5 That is, the unit motion synchronizing unit compares an event occurred by the input of a 

leading input person to an event occurred by the input of a subsequent input person, based on a 
time synchronized to each user on the basis of the set standard time that can be variously input 
by a number of users, to determine whether two inputs are matched to each other, so that 
simultaneity of motion occurrences is implemented. 

10 For this unit motion synchronizing unit to match the unit motions, it is possible to 

additionally use sound, if necessary, and at this time, usage sound includes WAV, MP3, WMA, 
MIDI and similar types of sound. In this case, it is possible to match motion flow to sound 
rhythm, and also to set a standard time by fitting a time progress in the sound and match it to the 
unit motion. 

15 The interface unit 130 interfaces the central processing unit, the ROM, the RAM, and 

the CRT controlling unit in the operational processing unit 110 to an input unit, a memory unit, 
and a display unit, which are external devices, so that the video and the sound are output 
according to events synchronized to the standard time. 

The output unit 140 outputs video and audio data. The output unit 140 allows 

20 transmitted and received data in a computer and a portable unit and the control or not of the data 
to be displayed on a screen of an image display device, such as a monitor, a head up display 
(HUD) device, an LCD panel, and the like, and allows input/output intermediation states to be 
confirmed by outputting a sound signal via a speaker or the like. Alternatively, the output unit 
140 allows input/output intermediation states to be confirmed through a separate device that 

25 outputs audio and video data. 

A motion synchronizing operation of the cooperative game system configured as 
described above according to an embodiment of the present invention will be described. 

First, the synchronizing unit 120 sets a standard time by using one of the aforementioned 
methods. 

30 The synchronizing unit 120 also sets a unit motion that moves during a unit time. In a 
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forward walking motion, an initial pose and a final pose in an arbitrary unit time are basic poses, 
and a unit motion for walking is carried out in the unit time period. 

For example, if a user inputs a walking motion event via the input unit 100, the 
operational processing unit 110 allows the event to be output at the output unit 140 via the 
5 interface unit 130 so that the structure performs a walking motion for the relevant unit time 
period in synchronization with a subsequent unit time from the input instant by the 
synchronizing unit 120. An event input by the user at an arbitrary instant within the unit time 
period when the structure is performing the walking motion is applied and is carried out to the 
structure during a next unit time, 
to Fig. 2 is a schematic functional block diagram for implementing a method for 

synchronizing motions in a cooperative game system according to an embodiment of the present 
invention. 

First, the input unit 100 comprises an input device 101. The input device 101 is a 
human interface, such as a keyboard, mouse, joystick, key panel, and dance pad, and generates 
15 an event by means of a number of keys on a computer or a portable unit. Further, the input 
device 101 may have a form, such as a direct input of motions via cameras or sensors, a 
command input by voice input such as a microphone, or an input by a network interface card 
(NIC). 

The synchronizing unit 120 comprises a DB processor 121, a virtual space processor 122, 
20 and a personal information processor 123. 

Here, the DB processor 121 makes a database for users' records, such as logged history, 
scores, and levels, in the form of data that may be included or separately added to the computer 
or portable unit, so that the present system retrieves the records, if necessary. 

The virtual space processor 122 stores a virtual space in a RAM of the operational 
25 processing unit 1 10 when the system is initiated, adjusts the virtual space according to a user's 
event input in use, and erases the virtual space in the RAM when the system is terminated. 

The personal information processor 123 is a module for processing the task of 
authenticating user's personal information when the system is initiated and storing the personal 
information when the system is terminated, in which the processing is made through network 
30 communication with a host server. 
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The operational processing unit 110 comprises an event processor 111, an access data 
processor 1 12, and a graphic user interface (GUI) processor 113. 

Here, the event processor 111 converts user input data from the input device 101, to 
access data according to the progress of the GUI processor 113. 
5 The access data processor 1 12 is composed of an access data transmitter and an access 

data determiner. The access data transmitter sends the access data, which has been produced by 
the event processor 111, to another client and accepts access data from another client. The 
access data determiner performs comparison of a time, which is a given condition, to required 
data and sends a comparing result to the interface unit 130. 
10 The GUI processor 113 allows the user to monitor, via the output unit 140, various 

situations progressed by the present system, and also serves to indicate a time point when the 
user must generate an event. 

The interface unit 130 comprises a motion progress processor 131. The motion 
progress processor 131 enables the unit motion set by the synchronizing unit 120 to be carried 
1 5 out at each client by using information delivered from the access data processor 1 1 2. 

The output unit 140 comprises an output device 141, and the output device 141 outputs 
the unit motion that has been processed by the motion progress processor 131, accompanied by 
the screen and the sound. 

Fig. 3 is a function block diagram for implementing a method for synchronizing motions 
20 in a cooperative game system according to an embodiment of the present invention in the form 
of a remote client system over a network. 

According to an embodiment of the present invention, the cooperative game system may 
be implemented in a server/client (S/C) scheme in which two client systems 310 and 320 and a 
host server 330 are interconnected, as shown in Fig. 3. Alternatively, the system may be 
25 implemented by a peer-to-peer (P2P) scheme. Alternatively, the system may be implemented 
by a video game machine scheme, such as PS2, XBox, GameCube, PSP, PSX, N-Gage, and 
Nintendo DS in which an on-line game or a two-or-more-person game is possible with a separate 
memory. 

A difference between the S/C scheme and the P2P scheme is caused from the number of 
30 connected users. The S/C scheme is applied to a case where a greater number of users desire to 
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be connected while the P2P scheme is applied to a case where only a few users are considered. 

In the S/C scheme, the host server manages a database, and processes information 
between persons through information processing by each client system. Event processing 
between respective remote client systems becomes possible based on the database in the host 
server and access data is shared between the client systems through access data processing. 

On the other hand, in the P2P scheme, two client systems process and then share 
personal information therebetween without a host server. In this P2P scheme, real-time 
communication or resource distribution for both an information sharing type and a resource 
sharing type are possible, and scripters such as Ping, Pong, Query, Queryhit, Push, and the like 
are allowed to be freely used. Further, in the video game machine, such as PS2, XBox, 
GameCube, PSP, PSX, N-Gage, and Nintendo DS, since the machine has a separate memory, 
managing the database and sharing access data between parties are possible on the memory. 

Each of the client systems includes the cooperative game system as shown in Fig. 2, and 
includes a structure moved by the event input from the input device, and a structure moved by an 
event input from another client system. 

That is, as shown in Fig. 3, in the case where two client systems are interconnected, two 
structures are displayed on the screen of the output unit of each of the client systems, one 
moving in response to the user event input from its own input device and the other moving in 
response to an event input from the party client system. 

Two client systems are synchronized to a standard time, and a unit motion according to a 
relevant event for the next unit time is executed by an event input for a unit time set at uniform 
intervals. 

Figs. 4 to 6 are flow diagrams showing a process of synchronizing motions in a 
cooperative game system including dance games, which is realized in the form of the client 
system of Fig. 3, and Figs. 7 to 23 are exemplary screens displayed on the monitor of the 
cooperative game system including dance of Fig. 4. 

For convenience of illustration, it is assumed that the gaming method of Figs. 4 to 6 is a 
cooperative gaming method including dance implemented in the P2P scheme. 

It is also assumed that a first player plays the game using a first client system and a 
second player uses a second client system, in which the first player is a leader and the second 
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player is a follower. 

When the standard time is divided into a number of unit time periods (World Time 
Code: WTC) set at uniform intervals, respective players input a motion event in an arbitrary unit 
time period. The input motion event is sent to the party client system over the network, and a 
motion corresponding to the motion event is displayed on the screen during a next unit time 
period (WTC). 

It is assumed that a motion event directly input by a player is a local step signal, and a 
motion event input from a party client system is a remote step signal. 

That is, in the case of the first client system, the motion event input by the first player is 
a local step signal, and a motion event input from the second client system is a remote step signal. 
In the case of the second client system, the motion event directly input by the second player is a 
local step signal, and the motion event input from the first client system is a remote step signal. 

Fig. 7 is an exemplary diagram of a GUI screen displayed on a monitor of a user. A 
step image 71 indicating stage background where dancing is shown and the step signals, a 
structure (character) 72 at a screen center portion, a unit motion input fail accumulating number 
or a success accumulating number 73, and a time gauge 74 are displayed on the user GUI screen. 
This time gauge 74 is a time when a unit motion can be input and indicates the elapsed time and 
remaining time in the present WTC. 

Fig. 4 is a flow diagram showing an overall process of synchronizing motions in a 
cooperative game system including dance games that is realized in the form of the client system 
of Fig. 3. 

First, if a game starts, a client system is synchronized to a party client system (S401). 

Figs. 8 to 1 1 and Figs. 16 to 19 are exemplary screens for a synchronizing process. 

First, a conversation window, on which players confirm the game start, is displayed on 
respective client systems, as in Figs. 8 and 16. If each of the players clicks on a confirmation 
button on this conversation screen, a background screen and a structure are displayed, as in Figs. 
9 and 7, and a client system waits to receive a synchronization signal from the party client 
system. If the synchronization signals are communicated between the two client systems, the 
client systems are switched to a service ready state for the cooperative game including dance 
games, as in Figs. 10 and 18. 
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If the cooperative game including dance games starts and one arbitrary unit time period 
WTC_i is initiated, as in Figs. 1 1 and 19 (S402), a motion input ready state is displayed on the 
screen (S403). When the WTCJ is initiated, a remaining time is displayed on all the systems. 
As the time elapses, it is displayed that an elapsed time increases and the remaining time 
5 decreases. 

A motion input processing subroutine is executed during a time period when a unit 
motion is allowed to be input (S404). Each player inputs a motion event while this motion 
input processing subroutine is being executed. If a first player as a leader first inputs a motion 
event, the step signal input by the first player is displayed to the first and second client systems. 
10 If a second player views the step image displayed on the screen and inputs a motion event, the 
step signal input by the second player is delivered to the first client system. Detail descriptions 
on this motion input processing subroutine will be described below with reference to Figs. 5 and 
6. 

That is, after the motion input processing subroutine (S404) is normally executed, each 
15 client system will have the local step signal according to the motion event directly input by the 
player and the remote step signal input from the party client system. 

Following the motion input processing subroutine (S404), it is checked whether the 
motion events input by two players match each other (S405). 

If it is checked at S405 that the motion events input by the two players match each other, 
20 a motion input success message is displayed on the screen as in Figs. 13 and 21 (S406), and 
rendering for the successfully input motion is prepared (S407). 

On the other hand, if it is checked at S405 that the motion events input by two players 
do not match each other, a motion input fail message is displayed on the screen as in Figs. 14 
and 22 (S408), and rendering for the input-failed motion is prepared (S409). This rendering for 
25 the input motion is processed in a WTCjH-1 period. 

If the WTC_i period is not terminated (S410), the motion input processing subroutine 
S404 may be re-executed when the motion input fails. 

If the WTC_i section is terminated (S410), it is determined whether the motion input is 
successful (S411). If it is successful, the number of success times is accumulated and success 
30 motion rendering is performed (S412), and if the motion input fails, the number of failure times 
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is accumulated and the fail motion rendering is performed (S413). 

It is then determined whether the game is over. If the game is not over, i is 
incremented by 1 (S415) and then process is returned to S403. Strictly speaking, although the 
successful motion rendering and the failed motion rendering in S412 and S413 are processed 
5 while S403 to S409 are being processed in the WTCi+1 period, they are separately illustrated in 
this embodiment to assist in understanding the present invention. 

The aforementioned cooperative game including dance games is over when the 
background music for the dance service is played out or the number of the accumulative fail 
times exceeds the prescribed number of times. If the background music is played out in a state 
10 where the number of the accumulative fail times does not exceed the prescribed number of times, 
a dance game clear screen is output, as in Figs. 15 and 23. 

Fig. 5 is a flow diagram showing a motion input processing subroutine for a first client 
system as a leader in the cooperative game system including dance of Fig. 4. 

If there is a key input from the first player (S501), it is checked whether the relevant key 
1 5 input is a normal motion event (S502). 

If it is not the normal motion event, a motion input fail message is displayed on the 
screen (S503) and the process returns to S501. 

If the normal motion event is input at S502, the first client system generates a local step 
signal (S504), displays the relevant local step signal on the screen as in Fig. 12 (S505), and 
20 transmits the local step signal to the second party client system (S506). When receiving the 
remote step signal from the second party client system, the first client system returns to S405 
(S507). 

Fig. 6 is a flow diagram showing a motion input processing subroutine for a second 
client system as a follower in the cooperative game system including dance of Fig. 4. 
25 When receiving a remote step signal from the first party client system (S601), the second 

client system displays the received remote step signal on the screen as shown in Fig. 20 (S602) 
and waits to receive a key input from the second player. 

If there is the key input (S603), it is checked if the relevant key input is a normal motion 
event (S604). If it is the normal motion event, the second client system generates a local step 
30 signal (S605), sends the generated local step signal to the first party client system, and then 
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returns to S405 (S606). On the other hand, if it is not the normal motion event (S604), the 
second client system displays the motion input fail message on the screen (S607) and then 
returns to S603. 

Although only two clients are shown as being connected to one host server in Fig. 3, 
more client systems can be connected thereto. In the case where a number of client systems are 
connected as such, interactions may occur between a number of cooperative game systems when 
a number of cooperative game systems play a game while individually implementing respective 
unit motions in one stage. 

For example, although a number of cooperative game systems individually implement 
respective unit motions, a case may occur in which the unit motions collide with each other in 
this implementing process, which makes it difficult to implement a correct unit motion. 

If, with respect to an event input by one player during any one of unit times in which 
progress is repeated in synchronization with the standard time, another player inputs the same 
event, each of the number of cooperative game systems realizes the unit motion corresponding to 
the input event through the structure during a subsequent unit time, and at the same time, allows 
interactions occurred by an individual unit motion implemented in each cooperative game 
system to be represented as a new unit motion, which is reflected to naturally solve the 
interactions by applying the aforementioned method for synchronizing motions in a cooperative 
game system. 

That is, it is allowed to enjoy the cooperative game generally full of reality sense on a 
virtual space implemented through connection of a number of client systems on various on-lines 
and webs, by synchronizing a number of client systems to the standard time, transmitting events 
generated by each of a number of client systems to party clients, synchronizing events generated 
during the certain reference period to the standard time, displaying an input event from a 
previous input client and an input event from a subsequent input client on the screens of relevant 
clients via a GUI, and displaying motions of one structure on the screens, in which one unit 
motion is realized according to whether the input events from the relevant clients match each 
other and at the same time, the game is played as one form by the interactions according to the 
unit motions realized by input events from other clients. 

In the case of the cooperative game including dance according to an embodiment of the 
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present invention, two structures (characters) are coupled to face each other, players move the 
structure through the unit motion having eight directions of front, back, left, right, front-left, 
front-right, back-left, and back-right, and the structure has twelve unit motions, including 90° 
rotation, 180° rotation, 360° rotation, and a separate special unit motion, in addition to the eight 
unit motions. A time taken to perform one unit motion ranges from WTC 1 unit to WTC 4 
units, and a first pose and a last pose of the unit motion are set to be matched to each other in 
order to make a pose of connecting respective unit motions smooth. Although the unit motion 
has been described herein only on the direction to assist in understanding the present invention, 
one unit motion may include several joints making up the structure in one unit motion and 
several motion modifications by the joints (e.g., a number of motion combinations such as lifting 
one arm up, shaking the arm a circle, bending and spreading the arm, lifting and then taking the 
arm down, and the like, or a number of motions combination according to directions, and arm 
and leg movements by key inputs independent of the directions). 

If the game starts, the first client system (leader) sends a WTC_i synchronization signal 
to the second client system (follower) as a playing time of the background music elapses. Each 
client system displays a step image corresponding to a motion event, inputted from the first 
player, as a hollow state during the unit time period WTC i. 

If the motion events input by the first player and the second player match each other 
after the unit time period, the client system may display it in a fully filled state, display that a 
motion according to input success for a next unit time period, WTCM+l, is proceeding or that 
connection of the motions is successful, by adding a point, and display it by means of, for 
example, a blue lamp, OK or success on the screen, if necessary. 

However, if the motions input by the first player and the second player do not match 
each other after the unit time period, a motion according to the input fail proceeds in the next 
unit time period, WTC_i+l, and unit motion input fail is displayed on the output unit. 

If such non-match between motion inputs occurs or is accumulated, the played game 
may be stopped, or point reduction, red lamp indication, or a message such as fail may be 
displayed on the screen. Alternatively, such information can be output through acoustic or 
voice methods other than screen output. 

At the last frame of the unit motion, the structure moves to a position of the last pose 
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and starts with a next unit motion. This is for solving a problem that an individual motion (a 
position that a foot reaches, and the like) taken by a model, such as a dance motion, a fighting 
motion, or the like, cannot be individually matched to the virtual space because the model or the 
like (object) moves in a constant speed and a constant direction if a movement of the object is 

5 handled as a velocity vector in the virtual space. 

Although the embodiment of the present invention has described that the first pose and 
the last pose of the dance unit motion are exactly matched to each other, this is only one example 
and the first pose and the last pose may not match each other. Further, it is possible to adjust a 
tempo of the playing time of the unit motion, if necessary. 

10 Further, according to an embodiment of the present invention, it is possible to 

implement a cooperative game including dance with a certain format by additionally displaying a 
series of step images on the screen of the player. 

Further, although the embodiment of this invention limits the number of the unit motions 
to twelve, it is possible to add or modify motions in the form of, for example, sitting, standing, 

15 bending, and continuously rotating according to the type of the dances, in addition to the twelve 
unit motions. 

Further, although it has been described that inputs are made by the input unit such as a 
keyboard, mouse, joystick, key panel, dance pad, and network interface card (NIC), a method of 
obtaining a position value by using various attached sensors or cameras for conjunction with 
20 virtual reality is possible. Alternatively, for an object to input motion data through combination, 
parallelism, and the like is possible. 

Further, although a model used in the client uses a typical two or three-dimensional 
object as an object, it is possible to implement the model through an avatar made by a separate 
modeling tool or through connection between an object, based on an image input via cameras or 
25 the like, and a real image. 

Further, it is possible to exchange conversation with parties through characters or voice 
by using a chatting tool, such as a messenger independent of the input unit. 

Further, although it has been described that the output unit outputs motions via a 
monitor or the like, it is possible to adjust one or more coupled object via wired or wireless 
30 transmission and reception to and from a solid object (e.g., animal, robot, airplane, or the like, 
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including humans). 

The present invention is not limited to the aforementioned embodiments and may be 
carried out in several forms. 

That is, the present invention is applicable to a three-legged game, or a variety of 

5 application games in which one structure must be formed and operated by two or more persons. 
For example, the present invention can be applied to a game that needs synchronization to a 
structure's unit motion and that requires balance maintenance, such as a Chinese lion game, a 
game with balance-requiring motions being applied, such as rope dancing, ball rolling, and 
human tower building by two or more persons, which may be found in a circus or a feat 

10 performance, a game in which a temporal or spatial effect by a mechanical control in a controller 
(i.e., an effect according to in-the-air, in-the-water, drag force and action/reaction in a space, 
etc.) is not handled as a simple time delay but is handled including physical effects upon 
controlling structure motions in a one-person simulation game, or the like. 

Further, the present invention can be applied to a game played by two persons, such as a 

1 5 sports dance. The sports dance can be played as motions by one or a combination of Latin five 
events, such as jive, rumba, chachacha, samba and passodobbele, and blues, swing, salsa, disco, 
twist, mambo, hip-pop, synchronized swimming, and ice dancing, in addition to modem five 
events, such as waltz; tango, fox trot, Vienna waltz, and quickstep. 

Further, although the embodiment of the present invention has illustrated the case where 

20 there are two players, the present invention is not limited thereto. That is, the present invention 
can be applied to a case where there are multiple players. 

Likewise, although the embodiment of the present invention has illustrated the case 
where two structures are played as one form by interactions, the present invention can be applied 
to multiple structures that are configured of one or more forms. 

25 An example of the aforementioned source program according to the present invention is 

as follows. 

// part D - after connect Game Windows display 
30 if( g_b_isConnectSuccess ) 

20 
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int iCount = 0; 

// App is now connected via DirectPlay, so start the game. 
gJhrResult = S JDK; 

5 // 

g_b_isLeader = g^pNetStage->IsLeaderPlayerQ; 
g^Remote^bjsLeaderJocal = g_b_isLeader; 
//myLog_Printf("\n - \n"); 
myLogJPrintf( ,f base at : b_isLeaderJocal : %d\n", gjpRemote->bjsLeader_local); 
10 // 

// Game application ceate 
// create multiplay two player 
pM2p == M2P_Create( 
g_app_hlnst, gapp_hWnd, 
15 Preset->Camera, 

Preset->Engine, Preset->iJWidth, Preset->i_Height, 

DebugPath, 

g_pRemote 

); 

20 

if (pM2p !== NULL) pM2p->bJsAfterCreate = TRUE; 

else MessageBox(NULL,"Failed to create a M2P structure! ! M 5 "Error n ,MB_OK), exit(-l); 

// after create signal 
25 // trans game data : after_create 
if(pM2p->bJsAfterCreate) 

HRESULT hr = S_OK; 
30 hr = SendTo_GameData(GAME_MSGID_AFTER_CREATE, (LONG)pM2p->b_isAfterCreate, 
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TRUE); 

if( FAILED(hr) ) 

MessageBox( NULL, TEXT("FAILED. :("), TEXT("g_pDP->SendTo"), MB_OK ); 

5 

f_01dTimeGetTime = (float) timeGetTime(); 
while (bjsWaiting) 

iftg pRemote->b isAfterCreate) 

10 

b_isRunning = JE_TRUE; 
bjsWaiting = FALSE; 

//for exit this loop 
15 if ( IsKeyDown( VK_ESCAPE ) ) 

//jeEngine_Printf(pM2p->Engine, 100, 100, "have been pressed ESC key"); 
bjsWaiting = FALSE; 
goto ENDJLOOP; 

20 

// 

if(PeekMessage(&Msg, NULL, 0, 0, PM_REMOVE)) //non-blocking message check 

// stop after quit message is posted 
25 if (Msg.message = WM_QUIT) 

// break; // < — loop ends here 

goto ENDJLOOP; 

TranslateMessage(&Msg); 

DispatchMessage(&Msg); 
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myLog_Printf("COMPLETE SYNCRONIZED STEP1 — — => \n"); 
//. 

f_01dTimeGetTime = (float) timeGetTime(); 
while (b_isRunning) 

//_ 

// Update the application 

if(!App_Update()) b_isRunning = FALSE; 
if (!App_Render()) b_isRunning = FALSE; 
if (! App_UserlnputO) b_isRunning = FALSE; 

if(PeekMessage(&Msg, NULL, 0, 0, PMREMOVE)) //non-blocking message check 

// stop after quit message is posted 
if (Msg.message == WMQUIT) 

break; // < — loop ends here 

TranslateMessage(&Msg); 

DispatchMessage(&Msg) ; 

END_LOOP: 

//. 

// for multiplay two player 
if(!M2P_Shutdown(pM2p)) 

MessageBox(NULL, "Failed M2P_Shutdown0n'7 'Error", MB_OK|MB_ICONERROR), _exit(- 

i); 

if(!myLog^Report("Debug_data_trans_test.txt")) 

MessageBox(NULL, "Failed my Log_Report()!!", "Error", MB_OK|MB_ICONERROR), _exit(- 

i); 
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// goto REENTRYJSTAGE; 

// 

if( FAILED( g_hrResult ) ) 

5 

if( g_hrResult = DPNERRCONNECTIONLOST ) 

MessageBox( NULL, TEXT("The DirectPlay session was lost. ") 
TEXT("The test will now quit."), 
1 0 TEXT("Dance P2P Test"), MBOK | MBICONERROR ); 

else 

DXTRACE_ERR( TEXT("DialogBox"), gJirResult ); 
1 5 MessageBox( NULL, TEXT(" An error occured during the game. ") 
TEXT("The test will now quit."), 

TEXT("Dance P2P Test"), MB_OK | MB ICONERROR ); 
goto QUIT_GAME; 

20 

/////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////// 

BOOL App_Update() 

25 // local 

float f_current_time; 
BOOL b_is Waiting = TRUE; 
int iCount = 0; 
assert(Preset); 
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//turn on the engine 

if (!jeEngine_Activate(Preset->Engine, JE_TRUE)) MessageBox(g_app_hWnd, "Engine did not 
activate", "Debug", MB_OK); 
//. 

// trans game data : befor_update 
pM2p->b_isBeforeUpdate = TRUE; 
if (!g_b_isFirstEntryToUpdate) 

if(pM2p->b_isBeforeUpdate)// && g_b_isSyncStepl) 
HRESULT hr=S_OK; 

hr = SendTo_GameData(GAME_MSGID_BEFORE_UPDATE, (LONG)pM2p- 
>b_isBeforeUpdate, TRUE); 
if( FAILED(hr) ) 

MessageBox( NULL, TEXT("F AILED. :("), TEXT("g_pDP->SendTo"), MB_OK ); 

// for(i = 0;i< 10000; i++) 

while (b_is Waiting) 

MSG Msg; 

//if( g_pRemote->b_isBeforeUpdate && g_b_isSyncStep2) b_isWaiting = FALSE; 

if( g_pRemote->b_isBeforeUpdate) b_isWaiting = FALSE; 

//for exit this loop 

if ( IsKeyDown( VKJESCAPE ) ) 

//jeEngine_Printf(pM2p->Engine, 100, 100, "have been pressed ESC key"); 
b_is Waiting = FALSE; 
return FALSE; 
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if(PeekMessage(&Msg, NULL, 0, 0, PM_REMOVE)) //non-blocking message check 

5 // stop after quit message is posted 
if (Msg.message = WM_QUIT) 

// break; // <— loop ends here 

return FALSE; 
TranslateMessage(&Msg); 
10 DispatchMessage(&Msg); 



myLog_Printf("COMPLETE SYNCRONIZED STEP2 —=—===> \ n "); 
g_b_isFirstEntryToUpdate = TRUE; 

15 

// 

// realized duality of f_current_time 

// if MP3 does not replay, abstract data from timeGetTime(). 
// if MP3 replay, abstract data using jeMP3_GetCurrentPosition(). 
20 //if ( !pM2p->myMP3->b_isTimerActive) 
if ( !pM2p->pMyMP3->b_isMP3Playing) 

f_current_time = (float) timeGetTime(); 

f_DeltaTime = (0.001f)*(f_current_time - f_01dTimeGetTime); 
25 fOldTimeGetTime = f_current_time; 

else 

fJDeltaTime = pM2p->pMyMP3->f_delta_time; 
30 f_current_time = (float) timeGetTimeQ; 
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f_01dTimeGetTime = f_cvirrent_time; 

//. 

// update multiplay two player 
if( 

!M2P_Update( 
pM2p, fDeltaTime, 
g_b_isSyncStep2, g_b_isSyncStep3, 
g_pRemote 

) 
) 

return FALSE; 

Preset->Camera = ViewMgr_GetCamera( pM2p->pView ); 
assert( Preset->Camera != NULL ); 
//all done 
return TRUE; 

// BOOL UpdateO 

////////////////////////////////////////m 

jeBoolean M2P_Update( 

M2PInfo *pM2p, float f_DeltaTime, 

BOOL b_isSync_PrevStep, BOOL b_isSync_CurrentStep, 

GAMEMSG_GENERIC2 *pRemote ) 

// 

//stage clear signal proccessing 
//(myMP3->b_isBeatScoreEnd processing) 
// send a signal from myMP3Mgr to timeline 
if(pM2p->pMyMP3->b_isBeatScoreEnd) 
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pM2p->pDancer->TimeLine->b_isStageClear = JETRUE; 
/* myLog_Printf( 

M pM2p->pDancer->TimeLine->b_isStageClear :%d\n", 
5 pM2p->pDancer->TimeLine->b_isStageClear 

); 
*/ 

if(!M2P_Update_Play(pM2p, f_DeltaTime, b_isSync_PrevStep, b_isSync_CurrentStep, 
1 0 pRemote )) return JE_FALSE; 
// ALL DONE 
return JE_TRUE; 

// M2P_Update() 
//_ 

15 jeBoolean M2P_Update_Play( 
M2PInfo *pM2p, float f_DeltaTime, 
BOOL b_isSync_PrevStep, BOOL b_isSync_CurrentStep, 
GAMEMSG_GENERIC2 *pRemote ) 

20 int i = 0; 

// start game? 

if (!pM2p->b_isBeforeUpdate_MP3 ) 

if (!M2P_IsGameStart(pM2p)) return JE_FALSE; 

25 if (pM2p->b_isBeforeUpdate_MP3) pM2p->b_isGameStarted = TRUE; 
//. 

// trans game data : befor_update_mp3 

if(pM2p->b_isBeforeUpdate_MP3)// && b_isSync_PrevStep) 

30 
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HRESULT hr = S_OK; 

hr = SendTo_GameData(GAME_MSGID_BEFORE_UPDATE_MP3, (LONG)pM2p- 
>b_isBeforeUpdate_MP3, TRUE); 
if( FAILED(hr) ) 

MessageBox( NULL, TEXT("FAILED. :("), TEXT("gjpDP->SendTo"), MB_OK ); 
return JE_FALSE; 



10 



if(pRemote->b_isBeforeUpdate_MP3 && pM2p->b_isGameStarted) 

15 if (g_b_isFirstTime) 

myLog_Printf("COMPLETE SYNCRONIZED STEP3 — => \n"); 
g_b_isFirstTime = FALSE; 

20 HRESULT hr = S_OK; 

pM2p->jeb_isStartMP3 = JE_TRUE; 

//myLog_Printf("pM2p->jeb_isStartMP3 : %d\n", pM2p->jeb_isStartMP3); 
hr = SendTo_GameData(GAME_MSGID_START_MP3, (LONG)pM2p->jeb_isStartMP3 ) 
TRUE); 
25 if( FAILED(hr) ) 

MessageBox( NULL, TEXT("FAILED. :("), TEXT("g_pDP->SendTo"), MB_OK ); 
return JE_FALSE; 
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// game Quit 

if(pM2p->jeb_isGameQuit || pRemote->b_isGameQuit) 

myMP3Mgr_Destroy( &pM2p->pMyMP3, &pM2p->pTP ); 
pM2p->pMyMP3 = NULL; 
pM2p->pTP = NULL; 

// 

if (!M2P_IsGameQuit(pM2p)) return JE_FALSE; 
// in case game over.. 

else if (pM2p->b_isGameOver || pRemote->b_isGameOver) 

myMP3Mgr_Destroy( &pM2p->pMyMP3, &pM2p->pTP ); 
pM2p->pMyMP3 = NULL; 
pM2p->pTP = NULL; 
//- 

if (!M2P_IsGameOver(pM2p)) return JE_FALSE; 
// stage clear.. 

else if ( pM2p->b_isStageClear || pRemote->b_isGameClear ) 

myMP3Mgr_Destroy( &pM2p->pMyMP3, &pM2p->pTP ); 
pM2p->pMyMP3 = NULL; 
pM2p->pTP = NULL; 

//. 

if (!M2P_IsStageClear(pM2p)) return JE_FALSE; 
// game progress.. 

else if((pM2p->jeb_isStartMP3 && pRemote->b_isStartMP3)||(pRemote->b_isStartMP3 && 
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pM2p->jeb_isStartMP3)) 

// for ( i = 0; i < 10000; i++) 

// for debug print 

// From pM2p->pDancer->b_isprint 
// to pM2p->pMyMP3->b_isprint 

pM2p->pMyMP3->b_isprint = pM2p->pDancer->b_isprint; 

if (pM2p->pMyMP3 !=NULL) rayMP3Mgr_Update(pM2p->pMyMP3, pRemote); 

// for debug print 

// From pM2p->pDancer->b_isprint 
//to pM2p->pMyMP3->b_isprint 

pM2p->pDancer->b_isprint=pM2p->pMyMP3->b_isprint; 

jeWorld_Frame(pM2p->pWorld->World, f_DeltaTime); 

//. 

if(!pM2p->b_isGameOver || !pM2p->b_isStageClear || !pM2p->jeb_isGameQuit) 

Dancer_Update( pM2p->pDancer, pM2p->Engine, fJDeltaTime, 

pM2p->pMyMP3->i_currentBeatIndex, 

pRemote ); 

//. 

jeVec3d_Copy(&pM2p->pDancer->v_originPointsOfCameraSpin, &pM2p->pView- 

>v_originPositionOfSpin); 

// check game stat 

pM2p->b_isGameOver = Dancer_IsGameOver( pM2p->pDancer ); 
if(pM2p->b_isGameOver) 

HRESULT hr = S_OK; 

hr = SendTo_GameData(GAME_MSGID_GAME_OVER, (LONG)pM2p->b_isGameOver, 
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TRUE); 

if( FAILED(hr) ) 

MessageBox( NULL, TEXT("FAILED. :("), TEXT("g_pDP->SendTo"), MB_OK ); 

5 

// check game stat 

pM2p->b_isStageClear = Dancer_IsStageClear( pM2p->pDancer ); 
if (pM2p->b_isStageClear) 

10 

HRESULT hr=S_OK; 

hr = SendTo_GameData(GAME_MSGID_GAME_CLEAR, (LONG)pM2p->b_isStageClear, 
TRUE); 

if( FAILED(hr) ) 

1 5 MessageBox( NULL, TEXT("FAILED. :("), TEXT( M g_pDP->SendTo"), MB_OK ); 



20 else jeEngine_Printf(pM2p->Engine, 250, 250, "waiting ..."); 
// all done 
return TRUE; 

iiiminiiiiiiiiiiiiiniiiiiiiiniiiiiiiiiimiiuiiiiiiniiiiiiiiiiiiu 

25 void Dancer_Update( 

Dancerlnfo *pD, // tester to move 

jeEngine *Engine, 

float f_DeltaTime, 

int i_BeatIndex_fromMP3, 
30 GAMEMSG_GENERIC2 *pRemote 
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) 

//local 

float fJTempo = O.Of; 
5 // ensure valid data 
assert(pD !=NULL); 
assert( Engine !=NULL); 
//- 

f_Tempo = TimeLine getTempo( pD->TimeLine ); 
1 0 pD->f_Tempo = fJTempo; 

if ( Dancer JsBeatScoreOK(pD) = JE_FALSE ) 

pD->m_current.i_numOfbar = 1 ; 

//TimeLineJSetMotionIndex( pD->TimeLine, pD->m_current.Mndex ); 

15 

else 

pD->m_current.fJime = pD->m_current.f_time + (f_ DeltaTime * fTempo ); 
//. 

20 if ( pD->m currentf time < pD->m_currentf_lenght ) 

if(pRemote->b_isLeader_local) Dancer_Update_setKeyInput_Leader(pD, Engine, pRemote); 
else 

Dancer_Update_setKeyInput_Follower(pD, Engine, pRemote); 

25 

// 

pD->b JsMotionEnd = JE_FALSE; 

//_ 

//motion end process 
30 if (pD->m_currentf_time >= pD->m_current.f_lenght ) 
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Dancer_MotionJEnding(pD); 

// 

pD->b_isStepscore_display = FALSE; 
5 pD->bJsStepscore_full = FALSE; 

Dancer_Update_setMotionEnd_Proc(pD, Engine, pRemote); 
//motion end process 

//- 

// motion render process 
! 0 if (pD->b_isCurrentMotionProc) Dancer JVIotion_Render(pD); 

else pD->b JsMotionEnd = JEJTRUE; 

// motion processing 

//. . 

1 5 // for debugging 

// Dancer_Check_TimeLine( pD, Engine ); 

// rtp sync 

20 float fterm = O.Of; 

BOOL bj-tpIsChange = FALSE; 

pD->i_rtp_percent_prev = pD->i_rtp jpercent; 
if (pD->m current.f time = 0) 

25 f_term = 1 ; 

pD->i_rtp ^percent = 100; 

else if ( (pD->m_current.f_time > 0) && (pD->m_current.f_time < pD->m_current.fJenght) ) 
30 f term = 1 - (pD->m _current.f_time/pD->m_current.f_lenght); 
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pD->ijrtp_percent = (int) ( f_term * 100 ); 

else if ( pD->m_current.f_time >= pD->m_currentf_lenght) 

fterm = 0; 

pD->i_rtpjpercent = 0; 

if (pD->i_rtp_percent_prev = pD->i_rtpjpercent) b_rtpIsChange = FALSE; 
else b_rtpIsChange = TRUE; 

if (!pD->Energy->bIsGameOver) TimeLineJJpdate( 
pD->TimeLine, Engine, iJ3eatIndex_fromMP3, 
pD->i_rtp_percent, b_rtpIsChange 

); 

//- 

Energy JJpdate(pD->Energy, Engine); 

// DancerJUpdateO 
//- 

void Dancer_Update_setKeyInput_Leader(DancerInfo *pD, jeEngine *Engine, 
GAMEMSGGENERIC2 *pRemote) 

//- 

// notify key input time to the time line 
pD->b_JsInputTime = JEJTRUE; 

if ( ( pD->b JsDisableKeylnputJromPlayer — JEJFALSE ) ) 

pD->b JsOK_KeyInputj6romPlayer = Dancer_MotionIndex_Assignments( pD ); 

if ( pD->bJsOK_KeyInput_fromPlayer ) 

II stepscore display control 
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// b_isStepscore_display : FALSE: Disable display; 

// b_isStepscore_full : TRUE : fulled image, FALSE : empty image 

pD->b_isStepscore_display = TRUE; 
pD->b_isStepscore_full = FALSE; 

5 // game data sending 

pD->i_display_index = pD->m_generic.i_index; 
if(!pD->b_isTransToRemote) 

10 HRESULT hr = S_OK; 

hr = SendTo_GameData(GAME_MSGID_MOTION_REQUEST, (LONG)pD- 

>m_generic.i_index, FALSE); 
if( FAILED(hr) ) 

MessageBox( NULL, TEXT("F AILED. :("), TEXT("g_pDP->SendTo"), MB_OK ); 

15 

// for debug print 
//pD->b_isprint = TRUE; 
pD->b_isTransToRemote = JE_TRUE; 

20 // Dancer_MotionIndex_Assignments() closing. 
pD->b_isDisableKeyInput_fromPlayer = TRUE; 

if ( pD->b_isOK_KeyInput_fromPlayer ) 

25 if (pRemote->l_MotionIndex_Request != -1) 

// is next motion OK, or fail? 

if ( pD->m_generic.i_index != pRemote->l_MotionIndex_Request ) 
30 pD->b_isKey!nputOK = JE_FALSE; 
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else 

// stepscore display control 
5 pD->b_isStepscore_display = TRUE; 
pD->bJsStepscoreJull = TRUE; 

// get Motion data 
Dancer_GetMotionData(pD); 
// 

10 // for prev. input 

Dancer_SetNextMotion(pD); 
pD->b JsKeylnputOK = JEJTRUE; 

myLog_Printf( ,, pD->b_isKeyInputOK : %d\n", pD->bJsKeyInputOK); 
l5 // 

pD->bJsOK_KeyInput_fromPlayer = JEJFALSE; 

// 

20 // void Dancer Update setKeyInputJLeader() 

//_ 

void Dancer__Update_setKeyInput_Follower(DancerInfo *pD, jeEngine *Engine, 
GAMEMSG_GENERIC2 *pRemote) 

25 //- 

// notify key input time to the time line 

pD->b JsInputTime = JEJTRUE; 

// recieved motion index from the leader 

if (pRemote->l_MotionIndex_Request != -1) 

30 
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// stepscore display control 

// b_isStepscore_display : FALSE: Disable display; 

// b__isStepscoreJfull : TRUE : fulled image, FALSE : empty image 

pD~>b_isStepscore display = TRUE; 
5 pD->b_isStepscoreJfull = FALSE; 

pD->i_display_index = pRemote->l JMotionlndexJRequest; 
if ( ( pD->bJsDisableKeyInput_fromPlayer = JE FALSE ) ) 
pD->b_isOK_KeyInput__fromPlayer = DancerJMotionIndex_Assignments( pD ); 

10 // 

if (pRemote->l_MotionIndex_Request != -1) 

if ( pD->b_isOK_KeyInput_fromPlayer ) 

1 5 // game data sending 

if(!pD->b_isTransToRemote) 

HRESULT hr = S_OK; 
20 hr = SendTo_GameData(GAME_MSGID__MOTION_REQUEST, (LONG)pD- 
>m_generic.Mndex, FALSE); 
if( FAILED(hr) ) 

MessageBox( NULL, TEXT("F AILED. :("), TEXT("g_pDP->SendTo M ), MB_OK ); 

25 // for debug print 

//pD->b_isprint = TRUE; 

pD->b JsTransToRemote = JEJTRUE; 

// Dancer JVIotionIndex_Assignments() closing. 
30 p D->bJsDisableKeyInput_fromPlayer = TRUE; 
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// is next motion OK, or fail? 

if ( pD->m_generic.Mndex != pRemote->l_MotionIndex_Request ) 
pD->b_isKeyInputOK = JEJFALSE; 



// for prev. input 

Dancer _SetNextMotion(pD); 

pD->b_isKeyInputOK = JE JTRUE; 

myLog_Printf("pD->bJsKeyInputOK : %d\n H , pD->b_>KeyInputOK); 
// . 

pD->b JsOK_KeyInput_fromPlayer = JE_FALSE; 

if (pD->b JsKeylnputOK) 

pD->bJsStepscore_display « TRUE; 
pD->bjsStepscoreJfull = TRUE; 



else 



// stepscore display control 
pD->b_isStepscore_display 
pD->b_isStepscore_full 
// get Motion data 
Dancer_GetMotionData(pD); 



TRUE; 
TRUE; 



// 



void Dancer_Update_setKeyInput_Follower() 



//• 
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//void Dancer_Update_setMotionEnd_Proc(DancerInfo *pD)//, float f_Tempo) 

void Dancer_Update_setMotionEnd_Proc(DancerInfo *pD, jeEngine *Engine, 

GAMEMSGGENERIC2 *pRemote) 

5 

if (pRemote->l_MotionIndex_Request = -1) pD->b_isKeyInputFailed = JE TRUE; 
if(!pD->b_isKeyInputOK) pD->b_isKeyInputFailed =JE_TRUE; 
else pD->b_isKeyInputFailed = JE_FALSE; 

pD->b_isInputTime = JE_FALSE; 
1 0 pD->b_isTransToRemote = JEFALSE; 
// remote motion index init. 
pRemote->l_MotionIndex_Request = -1; 

if (pD->b_isKeyInputFailed) 

15 

Dancer_NextMotionKeyInputISFail(pD, pD->TimeLine, Engine ); 

//. 

// Health Adjustment 
20 Dancer_HealdiStats_Adjustments( pD, Engine ); 

//. 

Dancer_SetCurrentMotion(pD); 
Dancer_GetBarsOfMotion( pD);//, f_Tempo ); 
25 pD->b_isMotionEnd = JE_FALSE; 
pD->m_current.f_time = O.Of; 
P D->b_isMotionEnd = JE_TRUE; 
pD->b_isKeyInputOK = JE_FALSE; 

pD->b_isDisableKeyInput_fromPlayer = JE_FALSE;// why ture? 
30 pD->b_isEnergyChange = JE_TRUE; 
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iiiiiiiiiiiiiiiiiiiiiiiiiiiiii/iiiiiiiiiiiiiiHiiii/iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii/iin 

myMP3MgrInfo * myMP3Mgr_Create( 
HWND hWnd, 
5 jeEngine *Engine, 
jeWorld * World, 

BeatScorePool *BeatPool, // Beat Score Pool 

const char* DebugPath 

) 

10 

// local variable 

myMP3MgrInfo *myMP3; 

TimerProcInfo *TP; 

// ensure valid data 
1 5 // create MP3 manager structue 

myMP3 = jeRam_AUocate( sizeof( myMP3MgrInfo ) ); 

if ( myMP3 == NULL ) return NULL; 

mymemset( myMP3, 0, sizeof( myMP3MgrInfo ) ); 

// create TimerProcInfo structue 
20 TP = jeRam_Allocate( sizeof( TimerProcInfo ) ); 

if ( TP == NULL ) return NULL; 

mymemset( TP, 0, sizeof( TimerProcInfo ) ); 

// structer Init. 

myMP3Mgr_Init(myMP3); 
25 strcpy(Debug_Path ,DebugPath); 

//. 

myMP3->Engine = Engine; 

myMP3->hWnd = hWnd; 

myMP3->World = World; 
30 // create sound system 
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myMP3Mgr_CreateSoundSystem(myMP3); 
// loading MP3 

myMP3Mgr_LoadingMP3(myMP3); 
//. 

// first MP3 play 

if (! myMP3->b_isMP3Playing) 

myMP3->LogoFinish = jeMp3_StandbyPlay(myMP3->SoundSystem, DM1); 

//_ 

myMP3->BeatPool = BeatPool; 

//. 

myMP3->i_currentBeatIndex = 0; 

myMP3->f_currntBeatTimeStamp = BeatScorePool_Get( myMP3->BeatPool, myMP3 
>i_currentBeatIndex ); 

myMP3->f_PrevPlayTime = BeatScorePool_GetPlayTime( myMP3->BeatPool, myMP3 
>i_currentBeatIndex ); 
// for stage Clear test 
//myMP3->i_beatUpperLimit = 6+1; 

//myMP3->i_beatUpperLimit = myMP3->BeatPool->BeatScoreCount +1 ; 
myMP3->i_beatUpperLimit = myMP3->BeatPool->BeatScoreCount -1 ; 

myMP3Mgr_TimerSetResolution( myMP3 ); 

//. 

TP->BeatPool = BeatPool; 

TP->i_beatUpperLimit = myMP3->i_beatUpperLimit; 
TP->i_currentBeatIndex = 0; 

TP->f_PrevPlayTime - myMP3->f_PrevPlayTime; 
TP->b_isBeatScoreEnd = myMP3->b_isBeatScoreEnd; 

//. 

S_myMP3 = TP; 
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//. 

// all done 
return myMP3; 

//. .// 

// myMP3Mgr_Update0 

// 

// Main application function. 

//_ 

jeBoolean myMP3Mgr_Update(myMP3MgrInfo *myMP3, GAMEMSG_GENERIC2 
*pRemote) 

//ensure valid data 
assert(myMP3); 

myMP3Mgr_transData_myMP3Mgr2STP(myMP3); 
//_ 

/* if (myMP3->LogoFinish == 0 && pRemote->b_isMP3 Started = TRUE ) 

*/ 

jeMp3_Play(myMP3->SoundSystem, 0, JE_TRUE); 
myMP3->b_isMP3Playing = JE_TRUE; 
//. 

// for myMP3Mgr_TimerProc0 
// f_DelayTime : unit : milli-sec 

if ( myMP3Mgr_TimerSet( myMP3, l.Of ) ) my MP3->b_isTimer Active = JE_TRUE; 
else myMP3->b_isTimerActive = JEFALSE; 

/* else if (myMP3 ->LogoFinish = 0) 

jeMp3_Play(myMP3->SoundSystem, 0, JETRUE); 
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myMP3->b_isMP3Playing = JE_TRUE; 
jeMp3_Pause(rayMP3->SoundSystem); 
if (myMP3->b_isMP3Playing) 
PostMessage( myMP3->hWnd, 

WM_APP_MP3_STATS,GAME_MSGID_MP3_STATS, 
myMP3->b_isMP3Playing 

); 

*/ 

// for debugging 

myMP3 Mgr_Print_Mp3Property(myMP3); 

// 

// for mp3 delta time 

myMP3->f_current_time = (float)jeMp3_GetCurrentPosition(); 
myMP3->f_delta_time = myMP3->f_current_tirne - myMP3->f_current_time_old; 
my MP 3 ->f_current_time_o Id = myMP3->f_current_time; 

myMP3Mgr_transData_STP2myMP3Mgr(myMP3); 

/* 

myLog_Printf( M S_myMP3->b_isBeatScoreEnd :%d\n", S_myMP3->b_isBeatScoreEnd ); 
myLog_Printf( "S_myMP3->i_beatUpperLimit :%d\n", S_myMP3->i_beatUpperLimit ); 
myLog_Printf( M S_myMP3->i_currentBeatIndex :%d\n", S_myMP3->i_currentBeatIndex ); 
myLog_Printf( M myMP3->b_isBeatScoreEnd :%d\n", myMP3->b_isBeatScoreEnd ); 
myLog_Printf( "myMP3->i_beatUpperLimit :%d\n", myMP3->i_beatUpperLimit ); 
myLog_Printf( M myMP3->i_currentBeatIndex :%d\n", myMP3->i_currentBeatIndex ); 
myLog_Printf( \n\n" ); 

*/ 

return JE_TRUE; 
// myMP3Mgr_Update0 
void myMP3Mgr_transData_myMP3Mgr2STP( myMP3MgrInfo *myMP3) 
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//ensure valid data 
assert(myMP3); 

S_myMP3->BeatPool = myMP3->BeatPool; 
S_myMP3->i J>eatUpperLimit = myMP3->i_beatUpperLimit; 
S_myMP3->i_cuirentBeatIndex = myMP3->i_currentBeatIndex; 
S_myMP3->f_PrevPlayTime = myMP3->fJPrevPlayTime; 
S_myMP3->b_isBeatScoreEnd = myMP3->b JsBeatScoreEnd; 

void myMP3Mgr_transData_STP2myMP3Mgr( myMP3MgrInfo *myMP3) 

//ensure valid data 
assert(myMP3); 

myMP3->BeatPool = S_myMP3->BeatPool; 
myMP3->i_beatUpperLimit = S_myMP3->i__beatUpperLimit; 
myMP3->i_currentBeatIndex = S_myMP3->i_currentBeatIndex; 
myMP3->f_PrevPlayTime = S_myMP3->f_PrevPlayTime; 
myMP3->b_isBeatScoreEnd = S_myMP3->bjsBeatScoreEnd; 

} 

According to the present invention as described above, in three-dimensionally realized 
computer graphics images, free representation for structure motions is possible, as well as 
structure motions that consider interactions between structures having a plurality of links can be 
realized by simpler and easier manipulations. 

Further, according to the present invention, physical characteristics similar to reality can 
be realized on structure motions provided through three-dimensional graphics images, and an 
overall structure can operate successively while maintaining natural poses. 
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